Skip to content

Conversation

@rowanc1
Copy link
Member

@rowanc1 rowanc1 commented Dec 23, 2025

Advances in artificial intelligence have led to claims that formal standards in scientific communication are becoming obsolete. If AI systems can parse PDFs, extract figures, infer metadata, and answer questions from unstructured text, why invest in shared formats and schemas at all? This framing misunderstands the role standards play. Standards do not merely serve machines; they shape interfaces, incentives, and social norms, determining what kinds of scientific work are produced, shared, and rewarded.

There is a parallel in software development: AI-assisted coding succeeds not because of chat interfaces alone, but because it builds on decades of tooling—IDEs, language servers, testing frameworks, and structured project context. By contrast, today’s scientific AI is forced to operate on PDFs, a print-era artifact that erases structure and constrains what researchers share. Chat interfaces layered on top of PDFs may improve access, but they do not directly change the underlying incentive system nor support or encourage richer, more reliable scientific workflows.

Meaningful transformation requires standards that treat research outputs as modular, contextualized objects—linking data, code, analyses, provenance, and computation as first-class components. Such standards enable new interfaces, support AI agents, and create pathways for social change by reshaping credit, transparency, and reproducibility. In an AI-mediated future, standards are not less relevant; they become the primary substrate through which scientific values are encoded and sustained.

@rowanc1 rowanc1 requested review from nokome and tracykteal December 23, 2025 19:04
@rowanc1 rowanc1 added the draft A blog post that is in draft, and should have a preview. label Dec 23, 2025
@github-actions
Copy link

github-actions bot commented Dec 23, 2025

Curvenote Preview

Directory Preview Checks Updated (UTC)
articles/2025-12-28-standards-and-ai 🔍 Inspect 13 checks passed (1 optional) Dec 23, 2025, 7:40 PM

@rowanc1 rowanc1 added draft A blog post that is in draft, and should have a preview. and removed draft A blog post that is in draft, and should have a preview. labels Dec 23, 2025
@rowanc1 rowanc1 added draft A blog post that is in draft, and should have a preview. and removed draft A blog post that is in draft, and should have a preview. labels Dec 23, 2025
@tracykteal
Copy link

I really like this! This is a really crucial point that standards are more important than ever, and importantly that they're not just for machines, but they shape behavior.

Could we include something around the idea that if we have identified a set of good practices, for that to happen, we need to build it into the structures of the ways we do and share science. So, standards can incorporate those good practices, and then by using them, we naturally are adhering to good practices.

I'm thinking of for instance of JOSS, where to get a paper accepted, you need to show that you've done a checklist of things like have an open source license, have the code somewhere public and under version control. The incentive is getting the paper published, but to do so, you must meet some standard good practices.

JOSS isn't a standard though. Could we point at an example of a standard that has helped change practices and culture?

@tracykteal
Copy link

tracykteal commented Jan 2, 2026

I can see that this is commentary that's emerging

A quiet claim has been gaining traction:
If AI can read anything, do we still need standards?

But I don't think I've seen that explicitly stated anywhere. Likely just because I haven't run across it. Is there something we could point to where this is being said?

@tracykteal
Copy link

I think there's some redundancy in a couple of the sections. I'm going to try some suggestions and will bring them back to the PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

draft A blog post that is in draft, and should have a preview.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants